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ABSTRACT 


CGRU is a CONVEUT program* COh'C its literal tTanscript1on into 
LlSFj realized in the CTSS LISP of Project MAC f for finding all the 
congruence relations of a finite state machine whose transition table 
is given as an argument * Central to both programs is the hull 
construction,, which forms the smallest congruence relation containing 
a given equivalence relation- This is dene by examining all pairs of 
equivalent elements to see if their images ara equivalent. Otherwise the 
image classes are joined and the calculation repeated, With the hull 
program, one starts with the identity relation and precedes by joining 
pairs of congruence classes in previously found partitions, and forming 
the hull in order to see if he may produce a new partition. The 

process tcminatas when all such extensions have been tried without 

, ■■ ■ 

producing any new relations* 



-i 
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A con p ,ruonca relation ill a finite state machine is alt d^ilivalcntd 
relation which Satisfies the intititnticil property, which requites that 
the images of equivalent states be equivalent* If M(SjW) la the transition 
function, this requirement is stated formally by requiring that, for all w* 
whenever states s and t are equivalent* so also are H(s,w) and M(tjW), 
Congruence relations play an important role in the theory of finite state 
machines; for example the minimal machine accepting a certain class of 
words may be found from any Other Such machine by forming the factor 
machine with respect to the largest congruence relation smaller than the 
equivalence relation of equal outputs* If a machine has two complementary 
congruence relations* it may be decomposed into the direct product of the 
two factor machines, If them is one non-trivial congruence relation* 
the machine may be represented as a serial combination of the factor machine 
and n fibre r.achinc. 

In order to have congruence relations available for such considerations* 
we discuss two constructions. The first is the determination of the 
smallest congruence relation smaller than a given congruence relation* 
which we may call its hull * The second is to systematically enumerate 
all the congruence relations for a given machine* This latter is done 
by first listing all the minimal equivalence relations* These are the 
equivalence relations in which there is only one point in each equivalence 
class* except for a certain pair of equivalent points. There is one 
minimal relation for each pair of distinct points. One then furms the 
hull of each of these n(n+l)/2 equivalence relations* Among the hulls 
will be included the minimal congruence relations, but there may well 
be included some larger congruence relations os well, One then continues 

by trying to join the equivalence classes found on the first round in all 

* 

possible pairs* and computing their hulls in turn* The process is then 
repeated until no new congruence relations are found* and an attempt 

has been made to extand those already found in all possible ways, 

.... . 

Two versions of the program are described, CGRU is a CONVERT 
program + while CONG is an equivalent LISP program. The existence of 
the two programs has permitted a comparison of the speed of execution 
of CONVERTj LISP, and compiled LISP program. 



The hull construction is quite straightforward* line examines 
one by ene all pairs of equivalent elements and tests their images 
according to the various possible input letters , If a pair of 
nonequlvalent images is found* their equivalence classes are Joined, 
and the procedure repeated* It terminates whan all pairs of equivalent 
elements end ail letters have been tested and no non-equivalent Image pairs 
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have been found* 
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If a poiv of 
equivalent points} 
have inoqulvalent 
images t join the 
inage aJasaes* 


convert can be caused to carry out the searching which we have 
described automati c ally t if we present the partition of the state set 
and the transition tabic properly* A partition is readily described by 
a list of its equivalence classes which in turn are lists pf mutually 
equivalent elements; thus if the integers l to 10 am partitioned into 
their residua classes modulo 3 wo would write ((147 10) (3 5 8) (569)) 
to represent the partition* The transition table takes the form 

(--- £* -** Cl ¥} «-) —) 

■ ■ ■ ■ ■ I I B B ' % ' 

to indicate that K(X^I) » Y* In other words t for each state we form a 
list beaded by that stats and followed by pairs of L*tt(?S and th* 
corresponding image, 

Ke make the following definitions. 


■Tp is 

the transition 

tab le t 

in the 

above form. 

a VAR* 

T 

PAT 

(■AJfD« L M) 




l , 

PAT 


(X mmm 

a u) —) —) 


■ K 

PAT 


a - 

(I V) •«) *==) 


im 

PAV 

£■*■ 

U 



■ 

(W) 

PAV 

(— 

V ™) 



. . . a a l. 

■I* 

1 

PAT 

£-*- 

(•AND- 

(«■ X 

—) (— Y 

—)) ■■■) 


PAT 

(XXX 

(UU) YYY (VV) 

111) 










The pattern is used to see whether there is an equivalence 
class containing the two equivalent elements X and Y, One might avoid 
the form “AN D™ by using Lin ordered variables, but the present form is 
more transparent. Thus -I*» matches any partition containing two equivalent 
elements (nut necessarily distinct], and hence will match any partition* 

The pattern T is designed to match a transition table but particularly 
such a transition table that II appears as the successor of X by the letter 
I and simultaneously V appears as: the successor of X by the sane letter 
1* Since U and V are not previously bound, T will match any well-formed 
transition table, but in the process will bind I, U„ and V, Next, we 
see that IRF and w are fragments, namely those partition cells which contain 
U and v respectively, Consequently, when we expect -0- to match the 
partition of the state set, we are expecting to find that U and V are in 
different ceils of the partition* 

If we then present CONVERT with the list {I T I) in which X is the 
partition of the state set and T is the transition table, and expect it 
to match (X T X] t& |>1* «T» ■Q«) # we are expecting it to find two 
equivalent elements X and ¥ and an input letter I such that fo(X,i) * U 
and M[¥,l) ■ V, and U and V are not equivalent. The fail procedure of 
the pattern matching apparatus will ejdiaust all possibilities befere 
finally giving a negative response. 

The hull construction is then effected by the function HU* 

HU REFT £f(X) |>F£PT- [X *TV X] *1 ( 

((*3- T ■{)■) [-HEPT- ((mfUU W) YYY ZZZ) 

■T» 

(XXX (UL W) YYY ZZZ)))) 

Cl « «) I) 

my 

Writing (HU X), we see that HU has one argument, which is listed when 
we evaluate the REPT skeleton. We thus extract the argument from this 
list in the first line, and make the couparisen which we have described* 

If there are elements with inequivalent images, their classes are joined 
in the form (Uu W] t and the entire process is repeated. Otherwise 
we accept the final partition as the hull* 

The hull function can be used to find all the congruence relations 
for a given machine* The construction depends on the fact that we can 
readily construct all the equivalence relations for a given set since it 
is only necessary to enumerate all the disjoint subsets. However, it is 



only necessary to initiate the process by an enumeration of the minimai 
equivalence relations* These are the ones for which only a single 
pair of point* are equivalent, all other equivalence dosses containing 
only single points, If we now find the hulls of all these partitions* 
wo are certain to find the minimal congruence relations* but we may well 
find larger ones also* Actually each hull has the significance that it is 
the minimum congruence relation for which the given pair of points are 
equivalent, but the equivalence of one pair of points may well force the 
equivalence of another pair and not conversely, so that the hull of the 
forced pair could be smaller than the hull of the forcing pair* 

Given a minimal congruence relation, there are at least two 
equivalent points* as the term "miniral” excludes the identity relation* 
The hull of those paint* must be the relation with which we commenced* 

Thu* a minimal congruence relation is the common hull of all pairs of 
points which it identifies. If some other pairs of equivalent point* 
generate a non-minlmal congruence relation* that is another matter* Soiree 
pairs of points am more congruent than others* depending on whether the 
least congruence Ire 1 at ion which considers theft equivalent is absolutely 
minimal or not* 

Our initial round then produce* at least the minimal congruence 
relations* and perhaps some others* h’e know that any larger congruence 
relation will have to join at least one pair of classes of a minimal 
relation. Simply joining two congruence classes need not produce a 
congruence class* so the hull construction is to he applied once more* 
ffc therefore make all extensions possible In this manner* and 

are thereby ensured of finding all congruence relations for which the 
possiblB triples of points are equivalent* It is more efficient to 
extend the first round of congruence relations than to find the hulls of 
all possible triples* in general* 

Tie algorithm then precedes as follows* first wo note the 
identity relation* which is always a congruence relation* Then we 
fom the hulls which consider the possible pairs of points equivalent* 

As each new hull is found* it is compared to see if the some as a 
previously found hull* and if not is placed on a waiting list* as well as 
on a list of relations to be extended* In this way w* have our initial 
selection of congruence relations* 


From this point an, we win take the partition* one by one from 
the waiting list and adjoin them to the finished list, in addition, we 
shall join its equivalence classes in ail possible pairs and form the 
hull of the resulting equivalence relation. Hath new hull so formed is 
compared against the waiting list and the finished list to see if it is 
new. When new, it is adjoined to the waiting list. Eventually no new 
partition* will be found and the process will terminate when the last 

waiting partition has boon extended* 

The comparison of two partitions is not automatic, neither in 
1*1 SP not in CONVERT j no more so than the comparison of sets, because 
aets may he equal without being represented by equal lists, One ruit 
cither write a special comparison function for sets which will pass through 
one Of them to sec if all its elements are members of the Other and 
conversely, or as we shall do in the present case, always reduce the 

list describing a Set to a Standard form* 

To create the standard formj we maintain a list of the state set 

in some arbitrary order. In our present program this state set is [*5*3* 

Ka shall require that the elements of a subset of S t such as an equivalence 
class, appear in this same order* The ordering is realized by a double 
complementation, and is effected by the function £NI X)* 

N1 . REPT £((*} (-COMP- (*S*) [-COMP- £*5*) X))]) 

Next, in any set of subsets which ara so normaliled, we require that the 
subsets be listed so that their first element preserves the order of (*S*), 

The function N2 achieves this ordering* 

N2 KEPT [ [ [X) (-ITER- I ( # S*) (*SKEL* I VAR 1 

[-when* x c«=- [r xxx) .») £(i m)) 0))}» 

■ 

Here we pass through (*S*) and if there is any subset which begins with 
the selected letter it is extracted and placed in order* 

Finally there is a function NO which will take an arbitrary list 
of psrtitions, norr.aliin them and eliminate duplications* 

NO REFT ((X (*U*I0N- [-ITER- I X {SI (-ITER- J I (Nl J] ))))]} 

- ■ a | i 

We have new seen the nwentiai stmctuTe of the program CGKU* it ifi 
organis'd » a program ^ whose program variAbies have the usage, 

(*A*) is used to store th* lotted of tho input alphabet 

-■ , ■ „ , "■ 8 . ■ ■■ ■ ■ ■ . u-" 

£*C*) is the finished list 

[*S*] is the list of internal State* 

£*P*) is the waiting list, and a temporary workspace, 

in addition, - 

-T- if the transition table, 











As a convenience, but also as a check against errors, the program 
initially computes the alphabet and the state iat, these could be input 
as data, hut are also imp licit1/ present in the transition table. 

Bucket Variables are used in the collection; 

AA for the alphabet 

| . . 1 

S3 for the state Set ■ 

while the collecting patterns arc 

{-£■) PAT ((*OR* (mmm (S£ -R-) -£*) (>»]}) 

C-S-> PAT t£*OR* tCAA S£) «F>) ())) 

Firstj, than, the alphabet and state Set are found, and the results 

are printed, as well as being stored in the program variables (*A*) and 

(*£*), ■ ' ■ 

The phrase (CONGRUENCE RELATIONS) js written* 

The identity relation is printed and stored in C*6*)* 

C*P*) is then set to a list of the equivalence relations of single pairs 
done in two stages; pairs are forced, and the remaining unit 
classes adjoined, 

1 is the label for the extension loop ' 

s . • . ..... 

The hulls of each of the partitions in (*F*) are formed* 

These are normalised and duplicates on the finished list are rejected, 

■■ is written to separate partitions found in different cycles* 
if no new partitions were formed, we finish, going to head 2* 

, . . ^ " 1 - - - ^ - ■ ■ ■ ■ ■ " ■ I 

The newly fc^md partitions art print b6 3 

> . ! . W 

and adjoined to the finished list, 

Otherwise the pair-joining extension is made for each of the 
newly found partitions, 

and the cycle is repeated* 

,2 is the label for the eric, 

which consists singly in writing (*=■*= GOODBYE »==«•) * 

. ■ . ■ ■ " ■ • i . ■ ■ rV" 

r 

It should be noted that the program speaks of extending the waiting 
list in one step while our description of the algorithm spoke of one 
partition at a time* This is because the individual steps are all 
encompassed in one *ITER», and hence the order of sene of the steps 
is slightly different, ■ 

" " ■ 

■ • ■■ ■ ■ ■ "■■■» 

Tti illustrate the pE&^Tam Kfi ntiw ConsidcT an illustrative ex;±T:ip 1 e. 
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The algorithm, although simple, calls for a considerable amount 
of calculation. Moreover* the amount rises rather sharply with the 
site of the machine since there are many processes which depend on the 

square of the machine order-thn Search to see If -equivalent elements 

have equivalent images, the starting step which considers individual pairs 
of equivalent elements, and so on, It already required about one minute 
or actual running time in CTSS LISP to analyse a feur state machine, which 
made this about the limit of practical sire, but hardly larger than could 
he readily analysed by hand. Accordingly, the program was rewritten almost 
verbatim in LISP and compiled* The principal function, [CONG T), ran 
about twice as fast as the CONVERT program CGRU when Interpreted, and 
38 times faster when compiled. Depending one's perspective, he would think 
that CONVERT was not inordinately slow, unless he considered the CTSS LTSP 
interpreter inordinately slow also. However the USP program was about 
twice as long, in the volume of letters which its statement consumed, 
and pTohabiy rather less transparent than CGRU, depending upon one** 
experience in reading LISP versus CONVERT, 

Since the two programs are identical in specification we shall not 
describe CONG separately nor shew an example Df its operation* However, 
in order to make the listing more understandable, we briefly describe the 
auxiliary functions upon which it calls, 

(CONG T) is the main function, which computes all the congruence 

* relations for the machine specified by the transition 

table T* This table has the form ('-«« (X (J Y] »-w) * . 
■■■) where X is a state, I an input letter, and Y the 
inage state MCX,!). 

It is a program whose program variables have the follewing 
.significance i 

A is the input alphabet 
• G is the finished list 

S is the state set \ 

R is the workspace holding the extensions of one relation 
V is the waiting list 

The steps of tha program axe nearly identical to the 
corresponding steps of CGRb, 

■ . . a ■ | .. .... 

i 

[ELEMENT XL) is a predicate* true if the expression X is found on 
., the list L, 

[Complement a hi is a list of all those members of a which do not ' 

belong to 13, A and E are both lists. Retained 
elements Occur in the original order with the same 
multiplicity. 


‘"" SET «ff.TSTJ M faSjUflwS' 

■ £ JW.ta, together Wffereet pel., of e^«l««. 

classes in A, FW if A - ttA) C&3 t c >)» 

(PATRSET A) - (CCA 3) (C)J((A C) {&0 (<J C ) W3 - 
v The joined class appears first* followed by thflS 

remaining, A partition of no or i*!™ J f 

correctly in the ini tUlit rti«i* ^ significance ol 

■ th® program variables i a 

I ranges through A. 

1 rafitrfrS through [CDH I) . _ * 

P retains the joined partitions already found, 

t™ I) .,£«*» ele^te « &"(■(«jjf 

ars^svs «‘»f » f 

Is a multiple Qccurrenea of on element* *11 b ^t its 
last instance is deleted* Thus* if L * (1 o l 1 □]* 

■ (NONredundant L) - (1 0). 

[REMOVE IJL) produces • list Mhos* elements are the elements of L, 

‘ except that both 1 and 5 .« dolotodi othewise tha 

order of the elements is not changed. If t* [tf l z z i uj * 

I * 0* J - 1* then [REMOVE I .1 L] = [2 2)* 

(JOIN IJL) assumes that its three arguments are lists* In tha 

present contentJ I and J arc equivalence classes, While 
l is a partition* I and J are appended* and removed 
from L.The value is a list of first the joined I and 
J, then the list L from which they have been, removed* 

(IMAGE S LT) assumes as arB«i"*nti a state S* a letter L “d a 

transition table T* Its value 1 ? the image of S hy L 
.. according to the table T, The function is a program 
which searches T until it finds a suhlist beginning 
With s* It then searches the CUR of this sublist to 
find a sub list beginning with L* whose CAl)R is the , . 

value* 

' (CONTAINING X L) finds the sub list of l which contains X* if any* 

otherwise the empty list, 

(hull p ATI is the analogue of the CONVERT function HU* which finds 
(HULL P A T) of *J ( partiti0 „ * according to tho mmdiln* 

which has alphabet A and transition table T* These iatteT 
night mil have hntft laft as free variables* 

Tht pragtar- variables siEflif^t 

Ai\ which ranges through the alphabet A as we 

test Images b y various letters 

vrhich range5 through a claps &£ the partition 
^hicb is the class to&taimhj the image of 1 
which ranges through "CCR of the class of I, 
forming the second eiemert of a pair 
which is the cl ms containing the lmsge of J 
Which ranges through the Classes of ?* I and 

*. . . , * ^ * *. *■ If 


I 

II 
J 

JJ 

K 
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The ope»ti«n of HULL follows exactly cur earlier 
description* 

(BLGINNING^X L) finds the sub list of L beginning with the expression 

Jt* otherwise the empty list* 

• mm m t l mm a mm " 

(NQRi L S) noma Uses the sub lists of t. with respect to the set 

[state set) S* In other words, the elements in each 
^ sub list are rsdc to appear in the sarnie order in which 

they appear in s* 

(NOB2 L S) normalizes the list L according to the list S in the 

sense that the sub lists of L are r.adc to appear with 
their first elements in the same order in which they 
appear in S* 

. 8 

(JQINNONNULL A R) CONS *s A to 0 unless W is null* in which case & 

remains unchanged* 

(NOUS P S) csuSnS each element of the list P to be rtOtnaLiled 

according to the functions N0R2 and NORl* 

(HULLS PAT) causes HULL of each element of P to be computed, 

(ADJOIN’ X L) places X on the list L if it is not already a member* 

■ (GATHER T)*. where T is the transition table* gathers all the letters 

of the alphabet and all the state symbols, mailing a 
list of these two lists* Its action is Exactly 
. analogous to the bucket variables which perform a 
similar function in 0GRU T 

Usage of the program variables is 

A to collect the letters of the alphabet 
$ to collect the state set 
U to retain (CDR T) while we search [CAR T}* 

After compilation* CONG required 20 seconds for a 6-state machine 
while CGRU required 70 seconds for a series of 4-stato machines which 
indicates that the practical limit may occur for 8 or ID state machines* 
although no effort was made to mahe accurate timing evaluations* The 
method wc have presented is completely straightforward* but to handle 
machines of moderate sire* further consideration is necessary to see how 
calculations may be simplified or avoided* For example* each time we 
see that two classes need joining in calculating the hull* wb start 
completely anew to test the extended relation* yet one can seejthat he 
will then uselessly have to repeat a great deal of calculation. Perhaps 
it would be worthwhile to test the resulting relation against the known 
congruence relations each time a juncture was made* since such a comparison 
would be much faster than testing all the pairs* 
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